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A study examined the linguistic strategies of strong 
and weak readers in grades three and six within the context of D. E. 
Rumel hart's interactive model of the reading process. A linguistic 
prediction task was set up to investigate students* use of 
orthographic constraints, syntactic redundancy, and syntactic and 
semantic knowledge. A program was written for a computer so the 
prediction +ask could be presented as a progressive cloze activity. 
The data were examined using inferential and descriptive statistics 
and detailed protocols of individual performances. Contrary to 
prediction, inferential analyses of the data revealed no significant 
differences between the groups of readers. Descriptive statistics 
shoved some of the problems underlying the application of inferential 
analyses. Protocol examination, comparing ihe performance of ideal 
readers with real ones, was the most revealing form of analysis as it 
showed the individual differences of children in using interactive 
processes to carry out language tasks* (Author/FL) 



ED 240 527 

AUTHOR 
TITLE 
PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 
ABSTRACT 



• l 



************************************************* 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
******************>**************************************************** 



ERLC 



X, 



NATIONAL l*5WUl| OF tlWCAHOW 

EDUCATIONAL RESOURCES INFORMATION 

center <tmc 

Thts ili>iumi»i>i h<h Own nettrnducwj at 
ham me £t>;a>rp or orif#rwarj0» 

DhujUlJftifHJ it 

M«itHT i h^Nijes, r>jV(* ftwi nude id unpiovt 
rebuMlmTi m qwUv 

# pLHOtSOf v*%* ii» rtu^Min^ ->t#lthr) m Th"5rtOtU 
mutton lit y 



READING AS AN INTERACTIVE PROCESS 



Larry Miller and Dale Burnett 
Queen's University 

Rena Upitis 
Harvard University 



-pCRMisstON roFiepsoouce this 

MAT€R»Al HAS BEFH GRANTED BY 

Larry Miller 



TO THE EOUCATlONAL R€SOURC€S 
INFORMATION C€NT€R fERlCt " 



Presented at the Eighth Annual Boston University Conference o 
language Development, October 8, 1983# Boston, Massachusetts 



Abstract 

This study examined the linguistic strategies of strong and 
weak readers in grades three and six within in the context of 
Riunelhart* s (1977) interactive model of the reading process. A 
linguistic prediction task was set up to investigate pupils' use 
of orthographic constraints, syntactic redundancy, and syntactic 
arxi semantic knowledge. A program was written for the IBM 5100 
desk top computer so the prediction task could be presented as a 
progressive bloze activity. The data were examined using 
inferential and descriptive statistics as well as by constructing 
detailed protocols of individual performance. Contrary to 
prediction, inferential analyses of the data revealed no 
significant differences between groups of readers. Descr ptive 
statistics showed some of the problems underlying the application 
of inferential analyses to the data. Protocol examination, 
comparing the performance of ideal readers with real readers, was 
the most revealing forra of analysis as it showed the individual 
differences of children in using interactive processes in 
carrying out the language task. An important feature of this 
report, therefore, is the comparison between the types of 
information one obtains by statistical approaches as contrasted 
with that obtained from qualitative protocol analyses. Such a 
comparison reflects the current debate on quantitative versus 
qualitative analysis as recently described by Light and ^illemer 
(1932) . 



READING AS AN INTERACTIVE PROCESS 

Larry Miller and Dale Burnett 
Queer * s Un iver si ty 

Ren a Upitis 
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Reading is one of the most researched topics in psychology. 
Many investigations have looked at how good a r id poor readers 
differ on a variety of variables. If the underlying causes cf 
children*s reading problems can be determined assume steps to 
ameliorate the situation could be taken. Thus, this type of 
research appears to be important in a real world sense. However, 
given the complexity of both print processing and the acquisition 
of reading ability, much is still to be learned. 

Early studies attempted to isolate variables believed 
crucial in the reading act. Tests for these components were 
devised and given to large groups of good and poor readers who 
were identified by performance on a standardized readinc test. 
Correlation coefficients were computed to determine variables 
important in differentiating good and poor readers. The 
so-called diagnostic/prescriptive approach to teaching was one of 
the results of this early work. Although later work used 
different, and perhaps more sophisticated methods of 
experimentation (e.g., Davis, 1944), the emphasis on finding 
important components of reading continued. 

It is i mistake to dismiss the relevance of early studies 
into reading. First, some work was ahead of its tine, *ooking at 
reading as a total communication process instead of a set of 
discrete skills (Huey>, 1908; Thorndike, 1917). Second, 
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£xplor in j issues that later prove to be unproductive is part of 
the evolutionary process of research* For example, many early 
studies looked at characteristics of poor and good readers* Poor 
readers were found to make more regressions than good readers; 
they engaged in more subvocalization; and they made more 
reversals* We know now these manifestations are not causes of 
poor readingi but rather, products* Practices associated with 
stopping symptoms of poor readingi such as manipulating text 
artificially so the reader cannot regress* are diminishing* 

The literature on good and poor readers is well documented 
(Vellutino, 1979; Samuels, 1971; Golinkoff, 1975*76)* Kleiman 
(1992) offars a useful critique of the problems in carrying out 
this type of research* They include choice of tests or tasks* 
ex per inental design # sampl ing , and measurement * Kleiman adds to 
these classic issues the critical problem of individual 
differences* Group studies assume homogeneity within each group 
of readers* Wiener and Cromer (1967) hint at this problem in 
proposing a variety of models to account for reading disability* 
soue appearing to assume individual differences* Applebee ( 1 971 j 
believes research into reading retardation must consider 
individual differences^, This study focuses on issues raised by 
Kleimam not to offer definitive answers but to explore the 
ramifications o£ proceeding in a given direction when carrying 
out research on good and poor readers* 

Purpose of the Study 

The purpose of this study was to explore tlie application of 
a model of the reading process to research on good and poor 

5 
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readers. Specifically,, *e applied Rumelbart f s (1977) description 
of reading as art interactive process. An ancillary '3oal was to 
examine the performance of the students who completed the 
specially devised language task using both quantitative and 
qualitative methods of analysis. 

Model s of Reading 

If, is difficult today to pick up a journal in psychology 
without seeing an article entitled "Toward a Model of Reading* or 
"A Cognitive Model of the Reading Process**. Models of readiny 
are not new. In 1960 Gray depicted what believed were the 
-major aspects of the reading process. Jack Holmes, working out 
of Berkeley, devised his sub-strata factor theory in 1953. As 
well, he stimulated a gifted group of graduate students including 
Harry Singer, Irene Athey, and John Geyer, to think about the 
reading process. His correspondence with Marion Jenkinson 
influenced her early calls for more useful models of reading 
(Jenkinson, 1970). Some ot her criticisms remain valid to3ay. 
She believed different models may be needed to distinguish the 
mature and the developing reader. There is little doubt we know 
more about the reading processes of Psychology 100 students th*n 
any other qroup of readers. Whether or not the processes of 
these students are isomorphic with children is debatable. 

Large numbers of reading models are accompanied by diversity 
in focus and orientation. Top-down* bottom-up and interactive 
are common terms applied, but there are psycho-sociol ingui st ic 
(Harste and Burke , 1978) , cognitive-developmental (^arsh, 
Friedman, Welch, & Desberg, 1981) and psycholinguistic (Smith, 
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1971) descriptions of reading as well. Many terms overlap. For 
example, Goodman's (1970) model is described at times as both 
top-down and psycho 1 injui stic . Interestingly enough , Goodman 
considers it an interactive model. In one sense the 
prol i faration of models is encouraging as it demonstrates a 
growi n ^ understanding of the in ter relation shi ps among the 
multitude of variables influencing reading. Models now take into 
account factors within the reader as well as the text. in 1971 
Mackworth keenly observed * * * ."reading* can only be defined in 
terms of "who* is reading what in what state for what reason (p. 
9-57)". Recent research dictates one would have to add, at 
least, 'in what cultural context' to this description (McDermott, 
1977) . 

Chapanis (1963) noted some of the general valjes and 
limitations of model building. Providing researchers with a 
framework for experimentation is one of the prime values. As a 
framework for this study we adopted the interactive model 
proposed by Rumelhart (1977). Here, reading is described as a 
set of parallel, interacting processes. To some degree 
Ru-iielhart's model resembles a board meeting where all the 
underlines bring their reports to the chairman who then 
synthesizes their views and makes the best decision from the 
available information. The information brought to the reading 
board chairman, or pattern synthesizer in this instance, can be 
graphic, orthographic , lexical , syntactic or semantic (see Figure 
1). Sines Rumelhart believes lower level processes are guided by 
more global higher level processes it can be assumed that the 
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A stage representation of an interactive model 
of reading* From Rumelhart, D*E. Toward an 
interactive model of reading* In S* Domic (Ed*), 
Attention and performance VI * Hillsdale* N*J*: 
Lawrence Erlbaum Associates , 1977 , at p* 588. 
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stage representation depicted in Fitj ur e 1 does not capture the 

interrelationships among the various types of information acted 

on by the executor* Indeed* Rumelhart sees interartion occurring 

along three dimensions: position along the How of print, levels 

of hypotheses, and alternative hypotheses at the same level* 

Research Ba c kground 

Rumelhart argues his model is testable using Baysian 

probab ' 1 i ties. However f our goal was not to test the viab i 1 i ty 

of Rumelh^rt's model. Instead, we decided to use principles 

based on a Rumelhartian description of the reading process to see 

how gocd and poor readers differed on a specific task* 

kumelhart's model lends itself to a £orm of analysis devised by 

Fillmore (1981) who is studying the differences in performance 

between ideal readers and real readers. An ideal reader ****is 

someone who knows, at each point in a text, everything that the 

text presupposes at that point, and who does not know, but is 

prepared to receive and understand, what the text introduces at 

that pMnt (p. 253)". Although we borrowed the general idea of 

contrasting ideal readers with real readers our research deviated 

frcm Fillmore's work since he is interested in the ways school 

chidren interact with standardized tests of reading 

comprehension* Thus, his segmented text presentation format was 

not useful tor our purposes* 

One of our major problems was to determine how an ideal 

» 

reader might process a text* An abstract analysis, using 
mathematical probabilities might be possible but it would be 
difficult given all the possible interacting variables* A second 



problem was how to deal with low level information such as e 
knowlelje of orthographic constraints* Especially with Jood 
readers, low level information is processed at a level o£ 
autonaticity* To solve this problem # Kolers (1968) used 
transformed text to study the reading processes ot university 
students* His technique produced a reading in slow motion 
effect* However, we planned to compare our ideal reader with 
elementary school children* Even with such techniques it is harj 
to ascertain whether or not a reader is aware o£, and usin3, 
orthographic redundancy* Adams (1980) points out some ways ot 
studying the question, but these methods often entail the use o£ 
a taahi sto^scope * 

K decision was made to use the progressive cloze technique 
which had been applied previously £or scaling the difficulty ot 
mater ials ^Carroll , 1971) * Fo±\ owing Shannon (1951) , the 
progressive cloze procedure requires subjects to guess a text 
letter by letter. One member of our team had been using just 
such a procedure over the past several years with undergraduate 
students enrolled in a faculty o£ education* The sentence, "The 
large duck quacked and jumped into the Ijssel River, *, was 
Revised to demonstrate how an interactive model o£ the reading^ 
process might operate* Moreover, the sentence had been 
programmed on a computer so students could complete the exercise 
prior to class lecture (Burnett and Miller, 1981-82;* Records ot 
their responses! both correct and incorrect guesses, were brought 
to class* Thus, we had a record o£ the performance ot 
approximately 200 university students* Given the simplicity o£ 
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tbs sentence we believed an ideal reader's performance could be 
constructed by examininj their records* 

Whenever one assessment methodology is selected over others 
there <ire tradeoffs. The progressive cloze procedure appeared to 
have several weaknesses* some of which were discovered as the 
research progressed. First* reading via a progressive cloze 
technique is not the same as reading a paperback novel for 
enjoyment or a textbook with the purpose of passing a test. As 
well* our task was essentially an encoding task vhile reading is 
decoding • Related to the encoding/decoding issue is spell ing 
ability* The data may be contaminated by children's inability to 
spell the words. The children's classroom teachers did not 
believe this would be a problem. However * the research assistant 
*Ao gathered the protocols was alerted to this possibility. If a 
spelling difficulty was perceived the research assistant was 
instructed to. determine its nature by asking probe questions. 
For example* If the child guessed the letter m j" after "lar* in 
the word large* she would say* "What word are you thinking of?". 
If the child* as expected* answered "large* * then the research 
assistant told the child that the ne*t letter was h g** not "j*. 
Oh *\je positive side the task did allow us to examine various 
aspects of the reading process including the use of orchographic 
constraints. Since we planned to interview the children as they 
worked through the sentence the slowness of the task became a 
virtue. The time it took to guess letters and to offer reasons 
for their selection were congruent. The task also allowed 
subjects to use language processes in an interactive manner, one 
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we folt hj.l similarities to the reading process, Th(*re were 
other limitations and values to our choice, so*ne of which will be 
discussed later in the paper* 

For many years* two research paradigms have dominated 
research in education and the social sciences. Generally 
speaking, quantitative research and qualitative resoarch have 
been regarded as fundamentally different* Quantitative research, 
where statistical results are presented on the basis of 
controlled experimental studies, is regarded as a different brand 
of research from qualitative studies that describe case studies 
or prototype a subject's choughts and activities. Recently, 
reviarchtrs have emphasizes the need to bridge the boundary 
between qualitative and quantitative research so the advantages 
of each could be emphasized. Light and Pillemer (19?2) express 
the need to acknowledge the limitations ot each approach by 
combining the strongest aspects of both research strategies. 

Light and Pillerner identify several reasons for using 
qualitative information in combination with quantitati/e 
information to increase the i ichness of both* Sorne of these 
apply to this study* First* since there wa i flexibility in the 
procedure used with the students, quantitative analysis is 
difficult and *itay be misleading when examined alone* When 
traatment is idiosyncratic # Light and Pillerner claim 
nonquantitative information is important in twb ways. 
Qualitative information is needed to document the process of each 
of the differing treatments al&ng with the corresponding 
outcomes, Also, to make some sort of overall statement abouc the 
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outcomes, qualitative synthesis, taking into account differing 
treatments, is more valid than quantitative synthesis* 

toother reason Cor using qualitative data is that some 
critical outcomes may be difficult to detect using quantitative 
methods (Ught and Pillemer, 1982)* Oversimplification of 
complex processes using simple numerical summary statements may 
result froft using quantitative analyses alone* Along with the 
oversimplification accompanying statistical analyses, there is 
also the danger of •'believing the figures'* to the degree that the 
results are accepted uncritically* 

Although Pillemer and Light focus on how quantitative and 
qualitative information can be combined effectively in literature 
reviews we believe many of their suggestions can be applied to 
individual research reports such as this one* Thus, we chose to 
supplement our statistical analyses with comparisons and 
contrasts of good and poor reader's protocols with an ideal 
reader * 

Metho d 

Subject s* Twenty-four students, twelve from grade three and 
twelve from grade six, were selected from a local public school* 
All grade three and six students in the school were included in 
the subject population* 

The subjects were selected on the basis of their reading 
ability based on standardized test scores (The Gates-McGinitie 
Reading Tests [Canadian Edition], Levels C and D) and teacher 
ratings* The students* relative performance on the 
Gates-McGl nl t le , Form 1 (Comprehension Section only) was used to 
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rank them as high, medium or low readers* Cut-o£f scores were 
chosen so that 25 per cent of the students would be rated as high 
readers, 50 per cent as medium readers, and the remaining 25 per 
cent as low readers* These rankings were compared to the 
classroom teacher's assessments of the student's reading 
comprehension abilities* in most cases, teachers* ratings 
con£i rmed the ind ications o t the standard i2ed reading test* 
Disagreement occurred in only a few instances where a child was 
closa to a classification border* In these cases, the teacher 
rating was used to rank the children *s reading ability* 

Once the students were ranked, a random sample comprised ot 
two boys and two girls ot each ot the grades and reading levels 
was taken* 

Appara tus* An IBM 5100 computer was used to deliver the 
exercise* This small, st*ad alone computer has a built-in 
screen* However, because ot the small size ot the screen a 
monitor was slaved to the computer for better viewing* Data was 
gathered by using a video tape recorder to record both subjects* 
and exper itnen ter * s comments along with the corresponding screen 
display* 

The Language Task * The sentence used in this study was first 
used with university students enrolled in an introductory reading 
and language arts education course* The sentence, "The large 
duck quacked and jumped into the Ijssel River* 1 *, was created to 
demonstrate how reading processes operate interactively* The 
sentence was constructed so the role ot orthographic constraints, 
syntax, semantics, redundancy, and pragmatics could be 
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demonstrated . The sentence did not appear to be too difficult 
for jrade three and si* school children. The exception, of 
course, is the word •Ijssel', which neither university nor grade 
school children were expected to guess easily. Using this 
sentence allowed us to construct a portrait of how an ideal 
reaier might solve the mystery sentence. This portrait could be 
compared and contrasted with real readers. 

Procedure . The language exercise was presented in an office 
located in the school . The students were excused from regular 
classroom activities to participate. The order of participation 
was arbitrary, often affected by other school activities. 

The students were presented with the following display: 

??? ????? ???? ??????? ??? ?????? ???? ??? ?????? ????? 

They were told to guess the sentence, letter by letter, from 
left to right. Students were permitted up to seven guesses for 
each question mark, and if the letter was not discovered in seven 
guesses, the correct ona was given. There was a tim3 limit of 35 
minutes allowed for participation in the exercise. 

Through the course of the exercise, the experimenter asked 
various questions. Students were frequently asked why a 
particular letter was guessed, or if a particular letter 
precipitated guessing a word. Sometimes the experimenter 
attempted to determine how certain a student was abcut the 
correctness of a guess before the guess was checked by the 
computer projram. In a few cases where a student was having 
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difficulty concentrating on the task, a more interactive 
procedure was jsed . For instance, the student couid *bet* or 
"exchange* letters, thereby allowing him "free* letters in 
situations where he might otherwise have wanted to abandon the 
task. As well as making the task more interesting to the 
student, this procedure highlighted the parts of the sentence 
that the student found easy or difficult. Thus, similar 
information was gathered from all students. The e*perimenter had 
no set list of required questions. Rather, she knew the type of 
information we wanted to obtain and formulated her questions 
accordingly. 

Resul ts 

Quant itative Analysis 

Analysis of the aata arising from this study is less than 
straijht forward. At first glance the structure for the analysis 
is well-defined: a 2x3 (grade x reading levels) fixed effects 
design with four subjects in each cell. Thus analysis of 
variance should be appropriate. Having defined the cells, one 
now proceeds to place the data in them. Here the shoals begin to 
emerge above the placid sea* What are the appropriate variables 
or dimensions for capturing the subjects 1 performance? At first, 
we can examine the total number of guesses required by each 
subject to complete the task - better readers should require 
fewer guesses. Most subjects were not able to complete the 
entire exercise in the time limit of 35 minutes, so the task for 
* the purpose of statistical analysis consists o£ the first eight 
words. Even with this decision there remains a difficulty* Due 
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to individual differences in the wa/ students responded to the 
set task, some students still failed to complete all eight words* 
Failure to complete the task implies fewer errors and hence an 
inflated performance index* Tte fill in the missing data with the 
maximum possible number of guesses is probably even more 
misleading since it would substantially increase the number of 
errors {at a rate of 7 x number of letters not yet attempted)* 
Instead a decision was made to "increase the homogeneity of the 
affected cells" by substituting the average number Kf guesses by 
other subjects in that cell who had completed an attempt at the 
letter* h total of six out of the 24 subjects had their scores 
adjusted in this manner, but only two had a substantive change of 
having more than 10 added to their total number of errors* 

The resulting means and standard deviations are given in 
Table 1; the corresponding 2-way ANOVA (fixed effects) is gWen 
in Table 2* The original hypothesis was that reading level would 
be a more important variable than age (i*e* grade level) in 
accounting for variability in performance on this task* Table 2 
indicates that this hypothesis was incorrect* Alternatively, the 
results reported in Table 2 could have occurred because this 
analysis somehow fails to provide a good snapshot of the actual 
event* Pursuing this latter interpretation* we decided to 
explore the use of different filters (creation ot derived 
variables, methods of analysis and presentation) to see if 
certain hidden features would emerge, thereby supporting tiv* 
or irjinal hypothesi s* 

One facet of the preceding analysis may be typified as the 



Table 1 



Means and Standard Deviations for Number of Errors 
by Readinc Level and Grade Level 



Grade 



Readi ng Level 

"Low Middle "*~Hpjb 



X 59. 50 66.00 50. 50 

<S 17. 40 5.79 9.08 

X 51. 25 56.25 39.00 

S 13. 27 13.59 5.05 
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Table 2 

Number o£ Errors 
AN OVA Table 



Source 



Read ing level 
Grade 

Interaction 
*3rro r (wi thin cell) 
Totals 



ss 




MS 


F 


177.2 


2 


88.6 


0. 46 


580. 2 


1 


500. 2 


3.04 


658.6 


2 


329. 3 


1.72 


3436.5 


18 


190. 9 




4852.5 


71 
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"fallacy of the IQ score** Two students may have the same total 
score, say 120, but one student receives an 80 on verbal and 40 
on non-verbal components and vice versa for the other* To say 
that both students have '•the same* IQ is silly* Similarly, the 
way in which individual students accumulated their errors across 
the mystery sentence varied appreciably, suggesting a finer 
grained analysis* To present a priori hypotheses from this point 
on would be deceitful, hence we shifted to descriptive 
statistics* 

One approach is to develop detailed composite profiles* The 
underlying assumption is that each group shoi +1 d be thocght of as 
a homogenous whole (a highly questionable assumption) and to see 
what differences and similarities are apparent among the groups 
on a letter-by-letter task performance* Tables 3 through 6 give 
the profiles for the high and low readers in both grades* The 
middle group has been omitted primarily for brevity* It is 
difficult enough to make statements about the extreme groups - 
inclusion of the middle group tends to add little information 
while complicating the structure and number of comparisons* 

One set of comparisons focuses on the relevance of letter 
position within a word* Thus one might hypothesize that all 
students are in similar position while guessing the first letter 
of a word/ but as the letters are progressively determined, the 
better readers should be able to take greater advantage of these 
cues and hence their error rate should improve (i*e*, decrease) 
relative to the poorer readers* A second factor that should 
influence student performance with respect to letter position in 
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Table 3 



Grade 3 Low Reader Composite Profile 
Number of Guesses for the Group (N 3 4) Before Success for Each Letter 







Position 


of Letter in Word 






Word 


1 


2 


3 


,4 5 


6 


7 To ta 1 


The 


9 


7 


0 






16 


large 


19 


2 


21 


15 1 - 




"i3 


duck 


12 


13 


8 


3 




36 


quacked 


22 


0 


14 


1 1 




0 33 


and 


0 


4 


0 


J 




4 


jumped 


23 


7 


7 


1 1 


0 


39 


in to 


* 20 


16 


0 


0 




36 


the 


0 


0 


0 






0 


TOTALS 


105 


43 


50 


20 3 


0 


0 227 
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Table 4 

Grade 3 High Reader Composite Profile 
Number of Guesses Cor the Group (N=*4) Before Success for E^ch Letter 



Position of Letter in Word 



Wbrd 1 2 3 4 5 5 7 Tctal 



The 


' 7 


0 


0 








7 




22 


5 


15 


12 


0 




54 


duck 


17 


14 


10 


0 






41 


qu*c ked 


28 


I 


0 


1 


0 


0 0 


30 


and 


14 


0 


0 








14 


jumped 


15 


4 


5 


0 


0 


0 


25 


into 


23 


1 


0 


0 






24 


the 


0 


0 


0 








0 


TOTALS 


126 


25 


31 


13 


0 


0 0 


19? 
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Table 5 

Grade 5 Low Reader Composite Profile 
MjTiber of Guesses for the Group (N»4) Befor-? Success for Each Letter 



Position of Letter in Word 



Word 1 2 3 4 5 6 7 Total 



The 


0 


0 


0 








0 


1 arge 


14 


1 


15 


3 






39 


duck 


23 


18 


16 


0 






57 


quacked 


28 


1 


3 


2 


7 


0 


0 41 


and 


6 


2 


0 








8 


jumped 


22 




I 


0 


0 


0 


32 


into 


7.i 


7 


0 


0 






28 


the 


0 


0 


0 








0 



TOTALS 114 38 35 10 7 0 0 205 
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Table 6 

Grade 6 Hiqh Reader Composite Profile 
Number of Gaesses for the Group (N*4 ) Before Success for Each Letter 



Po s i t I on of Latter in Word 



Word 


1 


2 


3 


4 


5 


6 


7 rota] 


The 


2 


0 


0 








2 


lar^e 


11 


1 


26 


17 


0 




55 


duck 


8 


11 


2 


0 






21 


quacked 


13 


0 


0 


0 


0 


0 


0 13 


and 


3 


0 


0 








3 


jumped 


22 


5 


7 


0 


0 


0 


34 


into 


21 


0 


0 


0 






21 


the 


0 


0 


0 








* 0 


TOTALS 


80 


17 


35 


17 


0 


0 


0 149 
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a word is related to the syntactic structure of most English 
language words* Thus, the first letter is often a consonant aad 
hence there are 21 potential candidates* Similarly, given that 
the first letter is a consonant* the second letter is often a 
vowel* The number of prime candidates is only five or six* Once 
again* th* third letter has a much larger set of possibil iti**5* 
although by now, with the first two letters known, there is 
additional syntactic and orthographic information available* 
Thus if one were to graph the number of errors by the position of 
the letter in a word* one would expect decreasing curves for ail 
groups, with a slight rise at the third letter, and Cor the 
curves of high and low readers to diverge as th3 letter position 
i^reases* Figure 2 Indicates that the curves clearly decrease 
as we expected but they converge instead of diverge* Two 
explanations cone to mind* Perhaps these curves are artificial 
constructs of the particular words in our particular mystery 
sentence* A second more likely explanation is that a form of 
•celling effect" is operating after the first three letters* 

Another set of comparisons focuses on the relevance cf word 
position within the sentence* This is ^strongly relate^ to the 
semantic content of che sentence* It is more difficult to 
predict the nature of the curve since a •difficult* 1 word would 
naturally cause a spike in the curve* Keeping this in mind* the 
curves should decrease and there should be divergence between 
high and low readers* Figure 3 gives the curves for the two 
extreme groups; grade three low readers and grade six high 
readers* A few comments deserve mention* Both curves have the 
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sane shape, rising and Calling together but the curve Cor the 
strong readers shows less variability because of the lower 
number of errors* Word order does not appear to be a dominant 
factor, the specific words in our sentence dominate whether the 
curve rises or falls* Thus words like •large*, 'quacked* and 
•jumped' have more errors than words like *the*, 'duck*, 'and* 
and 'into 1 * A confounding factor is word length although a 
review of Tables 3*6 indicates almost all errors occur during 
the first three letters* The one exception is the large number 
of errors for the fourth letter of •'large' 1 , corresponding in part 
to the low frequency with which •g* occurs in the English 
1 anguage * 

Before looking at a couple of individual profiles, we would 
like to present some of our data, embedded in the last figure, as 
a series of box and whisker plots (Tukey, 1977)* Such plots 
provide a good measure of the variability in student performance* 
Figures 4*7 give the plots for the second through fifth 
words* Explanations that overlook this variability are clearly 
incomplete* Thus on the word 'large*, the weak reading group 
shows more variation than the strong group as well as slightly 
better performance {!)* increase in variability in the weak 

group is even more pronounced for *duck*, but the strong group 
makes fewer errors* A similar pattern is noticeable for the 
other words* The larger variability for the weak readers Is 
suggestive of the idea that there may be many more reasons for 
poor performance than for good performance* This may be 
where the heart of the matter lies with respect to future 
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Qaalit atlve Analysis 

Readers: Ideal and Re al 

If a mature reader was asked to solve the mystery sentence 
how would she go about it? What strategies would be used? At 
what points would she work from words to letters, perhaps showing 
higher level processes control 1 ing lower level processes? Would 
protocols indicate evidence of pragmatics influencing guesses? 
How would orthographic constraints assist in the solution? And 
most importantly, how does the mature reader use linguistic 
information interactively? These questions can also be asked of 
the elementary school students used as subjects in this study. 

Tto supplement the quantitative analysis carried out on the 
data we first constructed a composite interview of an ideal 
reader. The composite interview was based on the responses of a 
large number of university students who completed the exercise on 
a computer or in small groups led by an instructor. The 
synthesized protocol was compared with those of real good and 
poor readers, the grade thr<=e and six children used i n this 
study. Although all ch*ldren were interviewed while they solved 
the sentence, only two analyses are presented here, one of high 
grade three readers and one of low grade three readers. Our 70a! 
is to demonstrate the potential of this type of analysis rather 
than to offer definitive answers as to how groups of good and 
poor elementary school readers differ from an ideal reader. 

Consonant with the interactive model of reading, information 
from many sources is used to solve the mystery sentence. The 
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hypotheses of the university students are not always correct* 
However, even incorrect guesses demonstrate an attempt at the 
best possible answer given the linguistic context, both within 
the te<t and the reader's mind* We\view this oehaviour as 
congruent with the example given by ^umelhart where plausible 
wortfs (hypotheses) compete for confirmation (Rumelhart , 19??, p* 
595, Pierre 10) * 

The following synthesized protocol, along with analytical 
comments, depicts how an ideal reader might solve the mystery 
sentence* Although the protocol is a cotippsi te , we present it in 
a realistic manner, as though one student i& completing the task. 
The comments f o ft en colloquial , are typical , and we used many 
quotes to retain a flavour of how students prcfcpeed through the 
mystery sentence* Specifically omitted are the comments of one 
student who struggled for a* proximately a half-hour, only to 
reach the word 'Ijssel** About the time be guessed the second S, 
he rose from his chair muttering oaths and incantations about 
crazy professors* 

Observer: Ideal reader, your task is to solve a ] 
mystery sentence* To do this you will guess- 
the letters in each of the words, in sequence, 
and one at a time. The question marks on thfe 
screen tell you how many letters are in each 
word* No other information will be given f If 
your guess is correct the letter vill be 
displayed in its proper place in the word* If 
the letter is incorrect, it will be displayed' 
below the word. After seven incorrect guesses 
the correct letter will be given to you* Now, 
what is the first letter of the first word? 

Ideal Immra, it's a three letter word that begins the 
Reader: sentence. Let's try T* 

0* : You're right* How did you get it? 
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W*ll, the word has three letters which doesn't 
seem like a lot ot help at first. Bat this 
three letter word begins the sentence 
and. ..well, r don't know bat the is probably 
the siost common three letter word that starts 
sentences . 

Comment: Hie strategy used by the I.R* is common* It 
might be considered a pragmatic strategy although the term is 
usually applied differently in the literature* Once the T is 
guessed the jJE are automatic. Two other common guesses are W 
and I* The W guess usually indicates the reader thinks the 
sentence is a question that begins with 'Why 1 (perhaps because 
of the use of question marks to indicate letter position)* The 
^ guess, although rare, is meant to be the uvrd 'I** Even 
mature readers will ignore cues {such as that there are three 
letters in the first word) and allow other cues to rule their 
g uess* 



0* : Continue* 

I.R* : The next letters are H and E* Tliat was easy* 
Let's see* The next word~has five letters, 
and it has to be a noun or an adjective* 
That's not much help* Let's try some 
consonants* T* No* S* Mope* How about B* 
Could be a vowel* Try JS* Wrong again. C* 
F? How many guesses is that? One more* ~D* 
15h , it's L* 



Comment: Adults tend to begin in the most logical manner 
possible* However, when they see their early responses are wrong, 
the most linguistically sound (i«e., high frequency letters} 
guesses are sometimes abandoned and a more random pattern is 
adopted* However, even here the guesses tend to be reasonable, 
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th*t is, they may switch to vowels but Z or X are infrequent* 
Also, rfhiie they sense the word must be an adjective or noun the 
futility of trying to use this information is quickly reco9ni2ed* 



I*R*: The next letter has to be a vowel* 
0* : Does it? 

I*R* : Well, ic doesn't have to be* It could be a 

'llaiaa'* (laughs}* I'll try vowels* J2* No* 
A* Got it! (I*R* begins to sound LA) * 

0*: What ara you thinking of? 

I*R* : Lamps* Mmmm * Lads, 1 amps , 1 ad ies* . *no * Try 
K for lakes* 0*K* how about C* T* 

0*: What were you thinking? o 

I*R*: Nothing really* Latin maybe? (nervous laugh) 
Maybe it is 0* is ladies spelled 'ladys' or 
'ladies'? 

0*: Maybe both spellings are correct* 

I*R*: D* Mo* £* Only two more guesses* Gee 

The * * *The* * * *lanes? N* One more* Maybe it's 

a vowel * 0* It's R* (sc unds LAR ) Lard * * *No , 
only four Tetters* ^Lards* Wierd* 

0* : What's the problem? 

I*R*: This is a toughie* Five letters* ** (Begins to 
say LAR again and again*) Try C* Mmmm* K* I 
knowTTargel Got itj The large* ** (voice 
trails off) 

Comment: The general strategy is to use top-down processing* 
Often students could be observed working backwords, that js, 
constructing an answer that was syntactically and semantically 
plausible* But there isn't sufficient information as yet to use 
this strategy effectively* The result is an interesting 
combination of thoughtful frustration* 
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0* : H*xt wcri please* 

I.R*; The large***Mnm four letters* What's large 

and has four letters* Could be a three letter 
noun with an S added* Of course, it could be 
another adjecTive too* Not likely though* 
Try B for boys* 0*K*, How about R for rake* 
I vtas raking ttie leaves yesterday* No* 0 for 
dogs* Hey, I got it* D* Oops* Hot dogs* 
The large (begins soundTng 0 5* K+ 

0* : Were you thinking of a word? 

I*R*: Well, it could be a lot of things* Has to be 
a vowel* It could be R but not likely* Try 
I # Gosh, maybe it is IS* U # So it's U* The 
Targe (begins sounding DU) * Mmmm* X TTnow, 
.luck* Righti* (The letters CK are filled in 
quickly and tr iumph&n tl y) * 



Coament: It is typical of university students to believe initially 
th*t identifying the first two words will open up the rest of the 
sentence* This euphoria dissipates as they realize adjectives 
or nouns beginning with any letter of the alphabet could fill the 
next slot* Students still work backwards, that is, from words to 
letters, but the futility of the strategy tends to persuade them 
to choose words that bc^in with high frequency letters* Thus, in 
essence, it appears as though students know when to abandon a 
top-down strategy and focus on bottom-up processing* 

Once the 0 in 'duck 1 is guessed orthographic constraints come 
into play* As well, students attempt to apply syntactic and 
semantic cues although there are still too many options to make 
this type of processing useful* Note the sophistication of the 
students in guessing vowels* Wrong answers turn out to be right* 
Given the linguistic context, A, E, I, etc* are better guesses 
than U, a low frequency vowel* Although there are other viable 
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words, 'duck* tends to be ascertained in three or four guesses at 
the :&ost. 



0. : What now? 

I*R.: The large duck... What do large ducks do? 

Swim* Ho, not enough letters* It has to be 
seven letter #ord* What do ducks do that 
takes sevin letters? Waddle* That's itl W* 
0*K., so they don 1 1 waddle here* Looked* ~" 
Leaped? (silence) 

C. : You seem to think the word is a verb* 

1. R*: Yes, it has to be. Well t it doesn't have to 

be***but it probably is* 

0* : What else could it be? 

I.R,: It could be an adverb .* .1 ike - The large duck 
happily**. Of course that wouldn't be good 
grammar , would i t? 

0. : I don't know* What do you think? 

I*R. : Gee, this isn't as easy as I thought. What do ducks 
do? Splashed* S. Nested* N. Try E* 

0* : Were you thinking of a word? 

?.R»: No* I could think of one though. Quack* Try 
quacked. Voilal (I*R* quickly types Q while 
laughing) * 

0. : Why are you laughing? 

1. R.: If it's Q it's got to be U. (I.R* continues typing 

in letters) . Must be an j?D at the end* 

0*: Why do you say that? 

I*R*i Well, it jnust be S or ED, quacks or quacked* 
And I have two leT:ters"Tef t. 



Comment: Once again, the ideal reader believes the solution is 
at hand. "What do ducks do?" she asks* This is a question we 
hear muttered over and over as students wrestle with the word. 
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It is a good question as it snows the I*R* is attempting to 
activate her schema for the word 'duck'* However, even at this 
early point in a simple sentence, the I*R* is attempting to 
use a variety of strategies, presumably in an interactive 
manner, to solve the problem* 

The number of letters l*\ the worU is some tWp but observe 
how the I*R* tends to ignore the specific number of letters, 
choosing long words instead* General word length seems to be a 
clue, but the reader does not focus on specifics* For example, 
'splashed* has eight letters While 'nested* has six* Both 
answers fit senantically and syntactically* 

Once the letter jj i s quessed the word comes quickly* On 
occasion, students will guess a word other than 'quacked* that 
begins with QU , but this is rare* 

The large duck quacked *** *three letters* 
Quacked out? No, doesn't make sense* 

What type of word fits? 
Lots* 

No un s? , 

No* Adverbs mostly* What else? Maybe 
conjunctions? Yea* 

Anything else? 

I suppose I could find a way to put almost 
anything there, but some make more sense 
than others* (silence) I'm thinking. 

What about? 

What could go there* Try F* The large duck 
quacked for his breakfast* Nope* Oh, it 
could be a preposition* I* Its* ** *guac!ced 



I.R. : 

0. : 

1. R. : 

0. : 

1. R. : 

0. : 

1. R. i 

0. i 
I * * * 
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i \% V^ai off. Gee, any other part of speech. 
WVit i - • Its 1 ? 

'J. : jfh*t -io you think? 

I.R. : 6 for but. {silence) A. 

0. : Are you thinking of a word? 

1. R.: (As the computer shows A to be correct.) I am now! 



Comment: As the sentence progresses students may apply more 
strategies to the task. Numerous options limit the effectiveness 
of these strategies until the initial letter is guessed. This 
breaks the log jam of options and the word is quickly identified. 

At this point, and sometimes earlier, it is common for 
students to attempt to complete the sentence. They are not 
concerned merely with local context but try to achieve closure on 
the entire thought. 



I.R.: {Mumbles sentence to himself.) What else do 
ducks do? Another Q. Quacked, quacked, 
quacked. Sounds lil<e a basal reader. Let's 
try waddled again. No W. D. C. 

0. : Where you thinking of something? 

1. R.: Climbed. Danced? Dancing bears but no dancing 

^ucks* Mromm. Let's go back to splashed. S. That 
was a dumb answer . 

D. : Why? 

I*R.: Too tiany letters* I didn't notice that "before. 

Oft, it's six letters this time. What else do ducks 
do besides quack? N. P. 

. 

0. : Were you thinking of a word? 



I.R.: No f guessing. One answer left. Try H for hopped. 
Do ducks hop? Guess not. I,'s J. dT r jumped. 
{Types in word,) 
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Comment: As before, many options face the reader. Making sense 
ot the sentence is still a goal though. Even whimsical answers 
such as dancing ducks are related to plausible situations. As 
with other words, the initial consonant, combined with syntax and 
semantics, are powerful clues. 

We notice students seldom slow down when they ccme to the JED 
in the word * jumped Their knowledge of language cells them 
tense should be continued so they supply this information 
instantl y. 



I.R.: repeats sentence up to the new word.) 

Out. No. Jumped onto? 0. Over maybe. 
Near . N. Rats! 

0. : What's the problem? 

1. R. : Lots of words can fit. 

0. * What kinds of words? 

1. R. • Prepositions. Let ,c see, what else? 

Adjectives? Adverbs? I forget. No, it must 
be an adverb. I don't know. Who cares? Try 
I for into. Ah-ha. (Types in into*) Next 
word — t he . It has to be 'the'. 

0. : Why? 

1. R. : It just does. It makes sense. Listen. The 

large duck quacked and jumfted into the (pause) 
river. R. no. S. B for brook. What else 
can ducks jump into? Maybe it's an adjective 
first. Nuddy river. M. 0. It's a salt 
water duck. Mmmm* T. My favorite guess. 

0. : Why is T your favorite guess? 

1. R. : Lots of words start with T. One more guess. 

D. (The letter I is suppTied by the 
'computer.) Wow. V?hat do ducks do that starts 
with _I? Is that a capital I? 

0. : What do you think? 
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T.R.: Yo'j koow# /ou souni like 3 psychologist. 

0. t it is a capital 

1. R. : Indian Ocean. Try N. (silence) What comes 

afte; I? V. M. This is tough. I thought it 
wouid get easier . 

0. : Why? 

I*R*: Because I have almost have the entire 

Sentence* Try £S* Island? Doesn't make 

sense. T* P. (Silence) JU 

0. : The next letter is J. 

1. R.: J* You've got to be kidding. (I.R. tries to 

sound out IJ; long silence .) 

0. : Guess a letter please* 

I*R»: Nothing makes sense* E. Maybe it's a vowel* 
I- 5- 2- 

0* : Why do you say that? 

1. R.: Because I have two consonants* Here's a wild 

guess. * .J. ^. Y . 

0. : The next letter is £i. 

1. R.: S? Are you sure? What is this, Russian? 

0. : What do you think? 

1. R*: Must be something foreign. Nothing is going 

to make sense. (silence) A. E. 1 + 0. U. 

0. : What are you doing? 

1. R.: Playing games. It roust be £ vowel now. Maybe 

it's Norwegian. What's that funny letter they 
use? 

0. : A thorn? That key is not on the computer. 

I*R*: Y. One roore. G* 

0. : The next letter is S. 

1. R*: 'Ijs'* Some word* J* Let's try soroe letters 

haven't used before. K. X- 2^- Another £5- 
Got onel Blind luck. — "* 
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0. : Why do you say t!iat? 

1. R. : This isn't English. Since I don't know the 

language I don't know what is coming next. 
•Xjss*. There mast be a vowel now. A. J. 
U. E. At last, something makes sense. One 
more letter. T. M* D. p* (silence) G- 
Mramm...into the {t7ies~"to sound out: Ijsse ) « 
B. C, 

0. : The final letter Is L. 

1. R. : How do you pronounce that word? {Tries 

pronouncing •Ijssel*.) One to go. 

Comment: Guessing the letters in •Ijssel 1 is a frustrating 
experience. The game has been changed, but initially students 
are unaware of the change. Semantics rules over both word length 
and syntax as evidenced by common guesses such as "pond*. As well, 
they attempt to apply the orthographic constraints of English to 
the word. After the first two letters are guessed, or given by 
the computer, they realize something is wrong. Eventually most 
surmise they are dealing with a foreign word. Interestingly 
enough, even thuU9h they realize the word is foreign they often 
continue to apply the orthographic constraints of English. 

I.R.: {Reads the sentence up to the last word.) 

Ocean. 0. Makes as much sense as Ijssel. 

0. : Does i t? 

1. R. : Not really. But it probably is a boay of 

water unless you have another trick up your 
sleeve, or computer. R for river. (The I.R. 
types in the rest of tTxe ward.) 

Comment: Students want to use their English linguistic knowledge 
once again although they remain skeptical. However, most focus 
on 'River* before the allowed seven guesses are up. 
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Real Readers — Low Grade Three 
The descriptions of real readers will follow a different 
format from that selected for the composite of the ideal reader* 
Rather than describing the responses of the real low grade three 
readers in detail, describing responses for all of the letters in 
the mystery sentence, selected aspects of the protocols have been 
selected to illustrate differences and similarities between ideal 
and real readers* 

Jackie * Jackie, a grade three low reader, entered the room and 

sat down at, the computer* The experimenter tried to put her at 

ease so she engaged Jackie in conversation for a few minutes* 

fcfter chatting about some of the school activities the 

experimenter described the task* Jackie said she understood and 

proceeded to guess the first word* By the time she guessed it 

her response pattern appeared as follows: 

The 
gu 

ev 
ap 
wb 
bd 
ct 
c 

When queried about her answers Jackie said she was thinking 
of the word *ai * f for A, 'wind* for W, and 'cold* for C* Notice 
both the disregard for word length and pragmatics* Although the 
experimenter was becoming suspicious about Jackie's answers she 
continued with the second letter* Ideal readers tend to guess T 
in one or two guesses, with the HE being automatic* One of her 
guesses confirmed the experimenter's hypothesis that Jackie did 
not understand the task, in spite of her claims to the contrary* 
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Experimenter: (after the response of V.) Were you thinking 
of a word there? 

Jackie : Yes. TV. 

E. : TV? ( Puzzled in flection . ) 

■Jackie: Yea * you know* like TV. 

The experimenter took time to go over the task again. However* 
Jackie still appear-s not to understand the nature of the 'game 1 . 
Once H is guessed* the final E is filled in 'the 1 without a miss. 

Protocol analysis of Jackie's first word guesses is 
repealing in that it shows the raw data for what it is — 
worthless for the purpose of evaluating Jackie's performance in 
this task situation. Jackie doesn't understand the task. This 
raises the issue of how many times children are asked to perform 
a task in school when they do not understand what is involved. 
The tragedy* however* is not in their ignorance of the nature of 
the task. It lies in the teacher's interpretation of the 
performance and the decisions made because of it. 

Marvin . Analyzing Marvin's protocol on the word 'large' reveals 

some interesting differences between the performance of ideal 

and real readers. His guesses are as follows; 

large 
l i be 
z od 

ei 

dt 

Pi 
cp 
mu 

Marvin guessed the letter L faster than the ideal reader. 
However* luck may be an appropriate explanation. Look at his 
second guess* Z* His guess pattern appears to be random rather 
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# than based on hiqh frequency consonants, about the only useful 

strategy a reader has in this instance* 

His guess of the correct vowel shows knowledge cf 
orthographic constraints in language, a trait we noted in most of 
the low grade three readers although this knowledge was not 
applied consistently* Notice some of the guesses once CAR is 
identified* Some, such as P, either violate the orthographic 
patterns of English or the pattern is rare* What we noticed in 
the protocol analyses of this group was a knowledge cf the -nore 
common orthographic constraints* Less common patterns were not 
perceived* We speculate such knowledge would not be available to 
these readers in a true reading situation either* 

Leslie * Ideal readers demonstrate a consistent pattern in 
solving the word 'duck 1 * h typical ideal reader pattern appears 
as follows: 

* 

duck 

torn 

se 

gi 

pa 

w 

b 

High frequency consonants dominate the guesses In the 
initial position as this is the only useful strategy* 
Orthographic constraints dictate a vowel or a highly constricted 
list of consonants to occupy slot two* Ideal readers guess high 
frequency consonants* The letter U is seldom guessed until these 
haue been exhausted* Once the first two letters are identified 
the next letter is guessed quickly as orthographic constraints as 
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well as syntactic and semantic knowledge can be combined with the 

knowledge of orthographic constraints* 

Leslie's pattern of guesses, typical of our grade three low 

readers, is depicted below: 

duck 
bot 
caa 
w b 
k p 

n 

s 

m 

Her guesses Cor the letter in the initial position are good, 
that is, they tend to be high frequency consonants. Once she 
gets 0 the letter U is guessed quickly* It shouldn't bel But 
Leslie's pattern is typical of grade three low readers* Instead 
of showing linguistic knowledge by not guessing U immediately 
they identify the correct letter within two or three guesses* 
Why? At first, we thought that they maybe working backwards from 
the word 'duck 1 * Duck is a common word in primary books so such 
a strategy seemed plausible* If you look at the guess patterns 
for the third and fourth letters* however, this doesn't seem 
likely* One student actually used up all of his guesses before 
the computer gave him the final letter in 'duck'* a sign that he 
did not capture the orthographic constraints ruling the response* 
We aren't certian what strategies low grade three readers are 
applying, but they are not productive* Meal readers apply rtK e 
strategies as information is revealed* As well, they apply these 
strategies in ever-increasing sophisticated ways* This doesn't 
appear to be happening with low grade three readers* 
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Ke n b . Solving 'quacked 1 is a lark for ideal readers* Once Q 

is identified, rfhich often takes five or more guesses, a chuckle 

accompanies the typing in of the entire word, including the ED* 

For at least some low grade three readers the obvious isn*t* 

Consider Kent's attempts on 'quacked** 

quacked 
e t 
t k 
u b 
c 1 
n o 
h u 
d 

There is nothing wrong with Kent's initial guesses although 

an ideal reader might include more high frequency letters. Also, 

when we asked the low grade three readers about their guesses 

they often indicated a top-down strategy, that is, working 

backwards form a word* Indeed, one child attempted to solve the 

entire sentence once she discovered 'The large duck* * She 

gleefully exclaimed, 'The large duck swam across the ocean'* 

This response may show little regard for the number of words 

remaining or their length, but it is a sensible semantic 

response* Kent's justification for some of his guesses show 

difficulties in using syntax as a useful cue* For example, when 

asked if he was thinking of a word when the letter H was guessed, 

Kent replied, "Heavy*** Other responses ('trie3' tor T) showed 
* 

a lack of sensitivity to word length. Once again, it seemed that 
more than one cue was being overlooked, applied improperly, or 
no t appl ied at all * 

Ideal and real low grade three readers differed distinctly on 
their guess patterns for the letter A in 'quacked'. Ideal 
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r^vlers sol/6 the entire word once (J guessed. But h is not 
as obvious jto the latter group. Kent's second guess was T for 
•cute*. Nbtice the graphopNonemic difficulties he is having 
here. Actually, 'cute* isn't that inappropriate, that is, like 
many children's invented spellings this makes sense. But it also 

r 

leads hip astray. For some guesses Kent could not offer a word. 

/ 
j 

"just guessing, * Kent would reply when asked if he was thinking 
of a word. In a genuine reading situation Kent may be using up 
valuable attention time tocussing on linguistic elements that 
cou^d be processed automatically. Thus, his inefficient 
strategies may be interfering with comprehension. 

Other Observations 

The four excerpts presented above demonstrate so^e of the 
differences between the solving strategies of ideal and real low 
grade three readers. As the latter group ,+ orked through the 
balance of the sentence we noticed additional differences, as 
well *s scne similarities between the two groups. 

tike ideal readers, most of the low grade three readers 
guess the word 'and* with little difficulty. But observe the 
pattern of one child: 

and 
t 
o 
r 
1 
e 
d 
k 

This child had little difficulty with 'quacked', getting the 
word with only one miss. In th<± case cf 'jumped' she identified 
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v-* **\ * i ^ t%*a; only four incorrect guesses. What 

T^ppen^'l with 'and'? We don't know, but some breakdown in her 
processing strategies is occurring* For example, when questioned 
about her T guess she replied the word was 'at 1 , a clear 
disregard of word length* The guess 0 stood for 'another 1 , a 
more blatant disregard of length, not to mention spelling* Low 
grade three readers s^wed this type of pattern. When they 
became confused or applied a strategy incorrectly they did not 
see the problem or the futility of proceeding in a given 
direction. Ideal readers not only know when they are on the 
right track but quickly abandon a useless strategy* 

A situation similar to 'and 1 arose with the word 'jimped 1 
with other children. Three of four readers got the word almost 
as quickly as ideal readers, but one child's guessing pattern 
looked like this: 

j uraped 

aaken 

bkr 

ewe 

dbd 

gew 

tvy 

lfi 

This student had just solved 'and' using the minimum number 
of incorrect guesses — zero! Notice his guesses for the second 
letter. Many break the rules of orthographic constraints. In 
most eases he was unable to offer any word as a possibility. It 
seeded he reverted to a bottom-up strategy just when top-down 
processing became highly feasible. Some of his guesses ignored 
both orthographic rules and syntax. For example, twice he said 
'water 1 when asked what W stood for. When the letters in 'jump' 
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were revealed, he said 'pond 1 . 

Again, it is the case of when things start to go wrong, they 
become a disaster. Linguistic strategies are not monitored to 
the degree that the child can alter his g*iess patterns to suit 
the situation. Contrary to Fillmore's definition of the ideal 
realer, he does aot know everything up to this point and doesn't 
seem to be able to receive new information. It is the 
Inconsistency of performance that is the most consistent* 



characteristic ot the low grade three reader. 

The word 'into* demonstrated the inconsistency of 

performance arother time. Two readers' patterns are similar to 

HeVt refers, while the other two readers had difficulty with 
» 

the word. One pa.ttera of a reader demonstrating difficulty is 
reproduced below: 



One "pi-ace ideal and real low grade three readers' 
performance converges is in solving the word 'Ijssel'. In fact, 
low readers may do slightly better since they adopt random guess 
patterns more quickly than ideal readers who cling to English 
strategies as long as possible. 

None of the low grade three readers in our sample attempted 
the word 'River'. The time allotted for the test sentence often 
expired on 9 Ijssel'. Wa speculate that slow performance 1* a 
characteristic of low grade three readers, and one that inhibits 
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their ability to apprehend meaning from a text. The inefficient 
strategies, dead ends, use up valuable processing time. As well, 
they rleter meaning resolution since the reader is pursuing cues 
inconsistent with the text or the rules of English (e.g., Tlie 
larje duck quacked and jump... - The '-nild says 'pond'.). 

Real Readers — High Gra_4^ Three 

There are two normal routes of analysis we could pursue in 
examining high grade three readers. Their performance may *be 
compared and contrasted with ideal readers or low grade three 
readers. Typically, investigations focus on one type of analysis 
only, usually the lacter. However, perhaps more can be learned 
by expanding the analysis to include a three-way comparison, that 
is, compare low and high readers to each other, but also compare 
them to ideal readers. In such a three*way analysis the key 
tiuestion is not hotf do good and poor readers differ but how do 
members of each group differ from ideal readers. Once this is 
known, comparisons and contrasts between high art2 low readers 
take on a different perspective. 

In this section we carry out the second leg of the analysis 
triad, a comparison of high grade three readers with ideal 
readers. Hie comparison of low grade three readers with ideal 
readers has-been reported. A final synthesis will be presented 
later in the paper. 

Bernice . At first glance, Bernice's profile appears similar to 
the ideal reader's performance. Consider her total record: 



ERIC 



53 



1*1 -k A 


large duck quacked 




j urn pea in co 




w 


bin 


CO 


f 


ts 


oa 


Wy 11 ill n 


A 


Slid 


ta 


j 


K 
O 


tn 


oca I am 


c 


t t 


fe 


s 


t 


f 


ptoaop 


b 


w 


si 


P 


g 


n 


snieur 


a 


h 




m 


n 


h 


rdeynt 


s 


r 




t 


P 


b 


aett s 


P 


P 




c 


3 


s 


bp r b 



It appears intially that Bernice* like Jackie, may not understand 
the task* She uses up all her guesses to identify the first 
letter* Her reasons for these guesses indicate differently* 
When questioned about the guesses Bernice said she was thinking 
about the word 'Why* or 'was* for W, •Did* for D# and 'Can* for 
C, etc* Bernice understands the task, and her answers indicate a 
top-down strategy* Moreover* she shows deeper knowledge about 
sentence structure* ?s seen in this exchange* 



Experimenter: What are you thinking about? (after B 
was guessed) 

Bernice: Well* I though,, W for 'Why* or maybe 'Mas'..* But 
that's not rightT It's not a question. I can't 
think of any other three letter words that start a 
question* It must be a sentence* 

Bernice understands the task* and her comments indicate a 

thoughtful approach to solving the first word* She even 

speculates on sentence type* Bernice's strategy is not the same 

as an, ideal reader though* at least in solving the initial word* 

After the first word is identified* Bernice's gue*s pattern 

* 

almost mirrors the ideal reader. She even guesses high frequency 
vowels prior to U in 'duck*. Like ideal readers she laughs when 
t£ is identified in 'quacked'* Her comments reveal congruenjy 
with ideal readers in terms of strategies also* For eKample* 
whan questioned about her strategy in identifying the £ in 
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•^Ija^ko']' B^rni^e replies, "Just guessing letters* Ducks could 
be loiryj anything After guessing mosc of the high frequency 
vowels for 'duck' she ways, "Weil, it could be a consonant 
blend*" This metalinguistic ability seems to be a common trait 
of both ideal and high grade three readers, it certainly is in 
Bernice' s case • 



Hugh ■ How typical is Bernice's performance of high grade three 

4 

readers? Our statistical analysis offered some group 
indications, but consider Hugh's pattern on the first three 
words* 

The large duck 
so zd bag 
w pv cer 
h tk rid 
j nh hof 
dm x n 
d y m 
s J 

Hugh used up many guesses in solving the first three words, 
more than ideal readers* Close examinination of his pattern 
indicates his-t3eviance may not be as great as first imagined. 
The word 'The' is guessed in the same manner as ideal readers* 
Likewise, his pattern for the first two letters of 'large' is hot 
different from ideal readers* It is only when he encounters flG 
that difficulty arises. Protocol analysis indicates a thoughttful 
top-down strategy at work* When Hugh guessed V after identifying 
CAR he muttered, "Not larva*** Other guesses were accompanied oy 
similar plausible words. Thus, although Hugh's pattern doe* not 
fit over the ideal reader's template his strategies indicate an 
attempt to apply interactive processes. Once Hugh managed to 
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ilentity 'duck' the balance of his pattern fit the ideal model* 

Brandy * Brandy's pattern, although different from both Bernice w 
and Hugh, points up the similarities between high grade three and 
ideal readers* When she was able to use top-down strategies 
Brandy applies them well* Comments such as "What do ducks do?" 
and "It has to be quecked** show the application of schema and 
orthographic constraints. Also, she demonstrates kncwledge of 
syntactic redundancy by not pausing when she encounters ED in 
•jumped** Perhaps the key difference between Brandy and ideal 
readers is the time allotted to solving the task* Brandy is 
deliberate, taking time to work through her guesses. Ideal 
readers appear to instinctively apply their strategies, reflecting 
on their thought processes after the fact* Brandy tried out 
different responses, testing them for a goodness of fit prior to 
typing them* 

Robert * In scanning Robert's response pactern there appears to be 
little difference from the ideal reader* The word *The' is 
'discovered with a minimum number of guesses? orthographic 
constraints are used when viable* and he applies strategies 
interactively* However, as with Srandy, one majo^ difference 
seems to separate Robert from ideal readers — speed* Although 
his pattern is similar to an ideal reader's, Robert only reached 
the word 'into* in the allotted time for the task (35 minutes) . 

Discussion 

The purpose of this study was to explore the usefulness of 
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**pplyirtjf a model of the reading process to examine the strategies 
of high and low readers* Two methods of analyses were used since 
quantitative and qualitative approaches tend to yield different 
types of information. Our focus was on ways of carrying out 
research more than looking for definitive explanations of how 
high and low readers differ* Additionally* while high and low 
readers* performance on the language task '.as compared, 
individual profiles were also matched against the template of an 
ideal reader * 
Models of Readi ng 

Are models of reading useful in examining the processing 
stratajies of high and low readers? Specifically* what is the 
value of Rumelhart's model? Based on our interpretation of the 
literature we believe the evidence supports a model such as 
Rumelhart's* Although Rumelhart's interactive model is useful it 
is not clear yet whether it should be preferred over similar 
descriptions of the reading process* Our investigation did not 
test Runelhart's model* we assumed ~ was a useful description 
of how the reading process worked* 

Che observation about the model did emerge when we 
constructed the ideal reader profile* the data fit the model* 
At first glance such a statement would appear to endorse the 
model* And we continue to believe it is useful* However, 
Rumelhart has produced a powerful model* one that may account for 
too ouch* To put it another way, it is easy to find ways of 
explaining different performances on our language task. We might 
argue that one reader was using the syntax of the sentence, or we 
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-:ould speculate orthographic constraints were guiding a response. 
It's disturbing when so many plausible possibilities fit the 
model. Based on the performance of over 200 university students 
we constructed an ideal reader profile* one who appears to be 
processing in a manner congruent with Rumelhart f s model. But 
rival hypotheses about how the ideal reader is functioning are 
possible . 

models of reading, as Chapanis (1963) pointed out* provide a 
framework for carrying out research. Research of this nature 
seems more productive than simply examining how good and poor 
readers perform on a large number of reading or reading related 
tasks. A, model offers some indication of the relative importance 
of a strategy or skill prior to investigation. 
Methodology — Quanta tat i ve and Qualitative 

Kleiman's (1932) warning about comparing only groups in 
research into good and poor readers is supported by our findings. 
To pursue a straightforward 2X3 fixed effects design would have 
offered little insight into the question of how high and low 
readers in the study differed. The Rumelhartian model might 
predict a fewer number of overall guesses for high rather than 
low readers but each word offered a unique "best solution" 
pattern. Only when the data was Presented as a series of box and 
whisker plots did interesting information emerge. The 
variability in the low readers* performance proved to be an 
important feature, a pattern different from high readers. It 
serms as though there may be many more reasons for poor 
performance than good peformance. 
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The quantitative analyses offered insights into the relative 
performances of high and low readers* They also guided us in 
exa't.inir*3 individual profiles* For example , we noted the large 
variability in low readers' performance through quantitative 
analysis* Protocol analysis 1 then helped us gain insights into the 
nature of this variability* The interviews aided in 
understanding why the performance of low readers was More variable 
than good readers* Therefore* we believe the two forms of 
analysis do complement each other, at least in this study* 

Protocol analysis complemented the quantitative analysis, 
thus extending our understanding of the data* However, the 
qualitative analysis struck out in new directions also* The 
compar ison of the ideal reader * s solving pattern and strategies 
with hi;jh and low readers was not a part of the quantitative 
analysis* We ?ould have carried out an ANOVA, comparin9 the 
performance of the high and low readers with the ideal readers* 
The data would be somewhat cooked however as one surmises the 
ideal reader solves the sentence the same way (perfectly, in 
light of the available cues) each time* Thus, certainly the Jow 
reader group's performance would differ significantly* In 
retrospect though, it would be interesting to see if the hi jh 
readers, especially the grade six group, differed significantly* 

Fillmore's (1931) idea of comparing ideal and real readers 
intrigued us* We used his general notion in a way different from 
Fillmore's original proposal which looked at how school children 
interact with reading comprehension tests* Whether or not our 
particular task was well suited for this type of analysis is not 
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as crucial as the nature of the analysis itself. But breaking 
away fro* comparing so-called good readers with so-called poor 
readers is necessary* Many critics of this type of research 
point out good and poor reader groups are described in a manner 
so incomplete synthesis studies of the literature are impossible* 
One study's gooi group may be the poor group in another study. 
Homing a model of reading, and building a portrait of an ideal 
reader given that model, seems to make sense. We believe more 
use of this technique will emerge as its value is seen* 

The protocol analysis was effective in examining the 
strategies used by students as well as their metalinguistic 
knowledge. The words a student uses to describe a task or 
strategy do not always lend themselves to a quantified form, out 
protocol analysis may capture this information. Special values 
of the interviews were clearly demonstrated when we discovered a 
chiLI who did not understand the directions* As well, students 
oft«n pronounced the word they thought fit into a slot, thus 
showing a top-down strategy. Simply counting their responses 
does not reveal the type of strategy used* Of course, at other 
times our suspicion of a top-down strategy was not confirmed as 
when J child would say, "Just guessing** 
The Tas k 

How useful is the language task we devised in examining the 
reading strategies of the chidran involved in this study? It has 
advantages, as outlined earlier* It did allow us to slow down 
the problem solving process* As well, it permitted us to gain 
insights into how these children manipulated various aspects of 



9 

ERLC 



60 



5?. 



ruling, so.ne within the reader and some within the text. 
Tsp-l'sitf) and bottcni-up strategies could be seen in guessing the 
lott^rs, so*ieti'nes both simultaneously. Therefore the task 
seemetj suita) for looking at strategies in the context of 
Rumelhart's model. These are positive features of the task, but 
some changes should be made if further research makes use of our 
procedures. 

Changing the task, as we ptopose here, is tied to computer 
speed. Our computer took too long in recording the children's 
answers, whether correct or incorrect. Although discussion is 
desired, some children became bored with parts of the task. A good 
example o* this situation is with the word "quacked" where they 
want it to appear quickly since they know it. Another 
illustrative case is when they have three or four ''good'* guesses 
in mind. If one doesn't work, children want to get on to the 
next, part of the problem can be handled in two ways, better 
programming and/or a more powerful machine. Speeding up machine 
response time leads to the possibility of changing the task in 
various ways. 

Past response time allows experimenters to increase the 
length of the text read by the subjects. Our sentence does not 
require understanding of intersentential constraints and 
relationships. More text would permit an examination of these 
language aspects. Another alteration would have the computer 
supply the word within a shorter guess period, that is, the 
subject would be given the letter after four or five guesses, not 
seven. This permits the reader to process more text although 
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valuable insights into processing strategies may be diminished by 
this format* The progressive cloze procedure could be modified to 
include words* Here the subject would guess whole words not 
letters* After so many incorrect guesses the computer supplies 
the word* This may be usefu 1 for looking at schema application* 
something not captured by* our sentence as all groups had adequate 
schemata to apply to the task* After all* the 3'jck only quacked 
and jumped* Kids knew they could do these things* As well* 
they knew the types of things ducks could jump into* 

The modifications described leave at least one problem 
unresolved* The task* as described* still requires encoding* 
Spelling ability contamination can be removed by using a word 
level progressive cloze technique* but this restricts the 
researcher's forujn for ~*uding subjects' knowledge ut 
orthographic constraints* This problem must be acknowledged if 
some form of th^ progressive cloze procedure is used* 
Classroom Application 

Direct classroom application of this research is not 
warranteuf nor was it the goal of the work* Nevertheless* there 
are some insights into both children's behaviour in general* and 
language tasks in particular, that appear useful* Protocol 
analysis showed the logic behind children's choices* Armed with 
this type of knowledge a teacher is in a better situation to help 
thp cb*ld* As pointed out previously* simply looking at 
responses can be misleading* This lesson is valid in both the 
laboratory and the classroom* 

Protocol analysis revealed at least two children who did not 
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understand the task given the standard explanation ana 
directions* Listening to one of these children, questioning her 
about responses, led to a clarification of the task. If this 
lack of understanding occurs in a one-to-one laboratory situation 
witn a trained experimenter, how often does it occur in a 
classroom with thirty children? Perhaps a great doal, but 
perceptive teachers can lessen the impact of misunderstood 
directions by circulating after a task is assigned, ascertaining 
understanding. In the second case, we suspected a lack of 
understanding. Here, conversation with the child indicated 
otherwise. Indeed, rather than discovering misunderstood 
directions we were treated to a discourse showing sound logic and 
processing strategies. The key point is talking with children, 
looking beyond the obvious. 

This key element - talk - can be applied in many other 
learning situations. What is behind the child's inability to 
solve a math problem? A conference may aid both the teacher and 
child. In composition instruction, the conference is gaining, or 
perhaps regaining, credibility as a valuable tool in developing 
the craft of writing. Teachers help children find topics, 
revise, and learn skills during these focussed conversations. In 
reading, strategies may be examined by listening to a child read 
aloud (miscue analysis). In all these situations, as with our 
study, talking to children adds meaning to numbers. 
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